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Abstract 

This research has aimed at constructing Criterion Referenced Test to measure the 
statistical competencies of the Post-graduate Students in Education Colleges in Yemeni 
Universities, at examining the validity of the test's grades (the descriptive validity and 
the Domain Selection Validity), at examining the test's grades Reliability according to 
(Livingston). In addition, it aims at determining the adequate Cut-off - Scores for every 
statistical Competency through which one can identify those students who are skilful or 
unskillful of this Competency, and finally to know to what extent the Post-graduate 
Students in Education Colleges in the Yemeni Universities are in full command of 
using these statistical Competencies which are included in this test. 

The researcher has used a method called Evaluation researches. The sample of the 
research has consisted of (157) students in the MA program. The researcher has 
constructed a test after following these stages (Analysis, test construction, try out, and 
print out the test) 

After following these stages the study has produced a Criterion Referenced Test to 
measure the statistical competencies of the Postgraduate Students in Education 
Colleges in the Yemeni Universities. This test includes (77) items which measure 
seven statistical Competencies which seem to be adequate: (Determining the basic 
statistical concepts and idioms- using and inferring the descriptive statistics- 
determining and explaining the connection element- using the parametric statistical 
methods- using the nonparametric statistical methods- reading and explaining the 
inferred results from the statistical program SPSS- and selecting the adequate 
statistical style). It has also been concluded that this test has a descriptive validity as 
well as Domain Selection Validity. It has been found that the test has a high 
Reliability according to Livingston which has reached at (0.99). The adequate cutoff - 
Scores is (0.63). There was also a clear decrease in the statistical Competencies of the 
students of the Postgraduate Students in Education Colleges in the Yemeni 
Universities. 

Introduction 

With the growing recognition of the importance of statistics and its multiple uses in 
the various fields of theoretical and applied knowledge, and in response to the 
movement of overall change that targeted all stages of the educational process in most 
Universities, statistics was scheduled as a mandatory subject for most Eaculty students 
as part of their program requirements; in order to enable students to analyze the raw 
data by converting it into figures that can be easily handled and analyzed, using the 
appropriate statistical tool or test. Thus, students get used to dealing with such 
programs and become fully prepared to interact with the statistical aspects of working 
life outside university classrooms, as well. (Rian, 2008) 


In fact, it has become necessary for each postgraduate student to have the 
competencies of basic statistics that help him cope with the fast developments and rapid 
changes of the scientific works; especially in the current era. In the past, research 
studies relied mainly on the traditional tests in which much interest was given to 
comparing the individual performance to his peers without giving much attention to 
identifying the knowledge and competencies that students can't actually achieve. 
Although most of the Yemeni universities have been newly established, they made 
much effort to qualifying their teaching staff by means of running postgraduate 
programs in some of their faculties of education. 

Objectives of Research 

This research aims at: 

1- Constructing Criterion Referenced Test to measure the statistical competencies 

of the Postgraduate Students in Education Colleges in the Yemeni 
Universities. 

2- Examining the validity of the test's grades (the descriptive validity and a 
behavioral Domain Selection validity). 

3- Examining the test's grades Reliability according to (Eivingston) 

4- Determining the adequate cutoff - Scores for every statistical Competency 

through which one can identify those students who are skillful or unskillful 
of this Competency 

5- Knowing to what extent the Postgraduate Students in Education Colleges in 

the Yemeni Universities are in full command of using these statistical 
Competencies which are included in this test. 

Method of Research 

The researcher has used a method called Evaluation researches because it has seemed 
to be the most adequate method to fulfill the aims of the research. 

Population and Sample of Research 

The sample of the research has consisted of (157) students who have been taught 
some statistical courses in the first semester of the academic year (2010/2011) in four 
Yemeni Universities which include the MA program in the faculty of education. 
These universities are Sana'a, Aden, Thamar, and Ibb. 

Tool of Research: The researcher has constructed a test after following these stages 
First: Analysis Process: This process includes these steps: 

- Determining the behavioral Domain of the competencies. This has been done 
by analyzing the description and the special aims of the courses of statistics which 
are presented to the MA students in the Yemeni Universities and also by seeking 
the assistance of some experts and specialists in teaching the course of 
psychological and educational statistics throughout distributing an open question 
about the statistical competencies which must be available with the students of 
higher studies in the Eaculty of Education as viewed by the specialist, then by 
having a look at the permanent references and literature reviews of the 
psychological and educational statistics. 


- Analyzing the behavioral Domain (to determine the statistical 
competencies). This has been done and resulted in seven statistieal eompeteneies 
whieh are: (determining the basie statistical concepts and idioms- using and 
inferring the descriptive statistics- determining and explaining the coefficient 
correlation- using the parametric statistical methods- using the imparametric 
statistical methods- reading and explaining the inferred results from the statistical 
program Spss- and selecting the adequate statistical style). 

- Determining the main aims for each statistical Competency as each one has 
been expressed by one general main aim. 

- Translating the general main aims into measurable and behavioral aims and 
organize them in accordance with the priority of each aim for the sake of 
achieving the main Competency. The behavioral aims are (83) distributed to the 
seven statistical competencies included in the test. 

Second: the Constructing Process: it comprises three sub steps: 

- Determine the bases of constructing the test which has been determined by 
eight bases. 

- Wording some experimental items in order to measure the measurable and 
behavioral aims. Some multiple four-choice alternative questions have been 
used. (Choosing the correct answer). 

- Judging the items. The experimental items have been shown to some experts 
and jurists in measurement, estimation and the educational statistics to judge 
the correspondence of the item with the behavioral aim and its capability of 
being estimated and presented for this behavioral aim. Those experts were 
(28). 

Third: The Experimental Process: it includes the following steps: 

Applying the test for a sample in the form of a questionnaire. The research 
sample has consisted of (120) students, males and females. 

Analyzing the items of the test by finding out the corresponding point 
between the item and the behavioral aim which it estimates then to 
examine the difficulty of the item. 

Checking the validity of the test's grades by using the descriptive validity 
through the sincerity of the jury and the linguistic determination of how 
the experimental items are related to its behavioral aims then to find the 
coefficient correlation of the (individual) item by means of the whole 
grade of the Domain of this item. This happens by using (p.p ) coefficient 
correlation and by counting the coefficient correlation of each Domain 
with the whole grade of the test by using the coefficient correlation 
(Person). 

The descriptive validity of the test's grades has been examined by using 
the indication of comparing two separate samples. This happened by 
determining the high group and the low group. 


The Domain Selection Validity has been examined by presenting a 
question to some professors who are majoring in teaching statistics course 
about the statistical Competency (which in case it is performed efficiently 
by the students it could be possible to issue a decision that he/she is very 
skillful at using statistics). 

The Reliability of the test's grades This has been achieved by using 
Livingston coefficient. It has been found that the test has a high Reliability 
according to Livingston coefficient which has reached at (0.99). 
Determining the adequate cutoff - Scores The researcher has used 
Nedlesky method to determine the adequate cutoff - Scores for every 
statistical Competency through which one can identify those students who 
are skillful or unskillful of this Competency. The adequate cutoff - Scores 
were (0.63) 

Fourth: to print out the final test and apply it to a sample of (157) students in the four 
Yemeni Universities which have been mentioned above. 

Results of Research 

After following these steps to construct the test and after analyzing the data 
from the First and the last application by using adequate statistical methods, it has 
been concluded that. 

1- The study has produced a Criterion Referenced Test to measure the statistical 
competencies of the Postgraduate Students in Education Colleges in the 
Yemeni Universities. This test includes (77) items which measure seven 
statistical competencies which seem to be adequate: (Determining the basic 
statistical concepts and idioms- using and inferring the descriptive statistics- 
determining and explaining the coefficient correlation- using the parametric 
statistical methods- using the imparametric statistical methods- reading and 
explaining the inferred results from the statistical program Spss- and selecting 
the adequate statistical style). 

2- The test has a descriptive validity as well as a behavioral Domain Selection 
valid based on some indications which have been used by the researcher. 

3- The test has a high Reliability according to Livingston coefficient which has 
reached at (0.99). 

4- The adequate cutoff - Scores have been found as that seen by the experts 
(0.63). 

5- There was a clear decrease in the statistical competencies of the Postgraduate 
Students in Education Colleges in the Yemeni universities let alone in the 
parametric and imparametric statistics and using the statistical program SPSS. 

Recommendations 

1) The professors, whose major is statistics in the Yemeni Universities, ought 
to update and develop their curriculums so that they could include all the 
important statistical subjects which are needed by the students of higher 
studies. 


2) The researcher recommends that all the statistics professors ought to use the 
test which has been conducted in this current study in order to be able to 
diagnose how far their students are skillful at the statistical competencies 

3) The researcher recommends the deanships of the Education Faculties to 
use this test as an admission test for enrolling the ( PhD) program in any 
major in the Faculty of Education since these faculties prepare researchers 
and educational professors. 
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